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Abstract . This  paper  denonstrates  how  tolutlona  to  partially  singular 
control  problems  can  be  obtained  as  the  limit  uf  nearly  singular  problems. 
The  asymptulic  analysis  involved  relates  to  a developing  (heurv  of  singular 
singular-perturbation  problems  and  is  of  independent  practical  interest. 

The  results  obtained  are  related  to  other  current  literature. 
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GENERAL  DESCRIPTION 


Now-classlcal  linear  control  theory  com- 
pletely solves  the  problem  of  minimizing  the 
cost  function 


J - I x’(l)nx(l)  ♦ 


5 £ "■ 


(1) 


(t)(7(t)x(t)  ♦ u' (t)R(t  )u(t  ) ]dt 


subject  to  tlie  state  equation 
X • A(t)x  B(t)u, 
x(0)  prescribed,  on  0 ^ t ^ 1 


(2) 


for  symmetric  matrices  T,  Q,  and  R 
which  are  respectively  positive  semidefinite, 
scrmldef  inite,  and  definite  matrices  |rf. 
Kalman  (1*160)  or,  e.g.,  Anderson  and  Moore 
(1971)  |.  Ue  shall  consider  the  singular 
problem  where  R is  a singular  matrix,  and 
shali  take  x to  be  an  n Vector  and  u 
to  be  an  m vector.  Though  such  singular 
problems  are  important  fur  applications, 
their  solutions  are  nut  readily  ubc.iined 
|cf.  Bell  and  Jacobson  (1975) |.  Jameson  and 
this  author  |cf.  O'Malley  and  Jameson  (1975, 
1977)J  obtained  very  satisfactory  solutions 
to  certain  totally  singular  problems 
(R  i 0),  by  considering  them  as  the  limit 
pf  nearly  singular  problems  with  K ■ c^R, 

R nonsingular,  as  tls*  small  positive  param- 
eter t tends  to  zero.  This  idea  was  used 
earlier  in  the  singular  control  literature 
by  Jacobson  and  cuworkers  to  both  theoret- 
ical and  numerical  advantage  Icf.  Jacobson 
and  Speyer  (1970;  and  J.icubsun  et  al.  (1970)  | 
and  la  analogous  to  the  common  use  of  artl- 
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flclal  viscosity  in  the  fluid  dynamics  lit- 
erature |cf.,  e.g.,  Rlclitmyer  and  Morton 
(1967)  and  Ru.ache  (1972)).  We  note  Ch.it 
problems  with  singular  or  nearly  singular 
matrices  R also  occur  naturally  in  deter- 
ministic, stochastic,  and  distributed 
parameter  problems  Icf.  Kw.ikern.iak  and  Slvan 
(1972),  Friedland  (1971),  and  Lions  (I97J)). 

We'll  study  the  partially  singular  situation 
where  the  matrix  R is  singular  and  of  con- 
stant nonzero  rank,  by  considering  the 
asymptotic  solution  uf  the  nearby  nunslngu- 
lar  problem  with 


S dl.ig  (Rj,  t^R^)  (3) 


where  R^  and  R^  are  nonsingular  m^  > m^ 
and  m^  • m^  matrices  with  m^  ^ m^  ■ m. 

Related  approaches  to  partially  singular 
problems  liave  been  previously  .inalyzed  hv 
Wumble  et  al.  (1976)  and  Hutton  (197s). 

Since  the  last  m^  components  of  Che  con- 
trol are  "cheap"  compared  to  the  first  m^ 

components,  we  might  expect  those  components 
of  the  optimal  control  to  Involve  large  ini- 
tial impulses. 


The  classlc.il  Kalman  theory  Implies  th.it  the 
optimal  control  for  the  linear  regulator 
problem  (l)-(2)  is  given  hy  a feedback  con- 
trol law 

u - -R'^B'kx  (4) 

where  k is  Che  unique  symmetric  posiclvc 
semidefinite  solution  uf  the  n s n neitrix 
Riccaci  terminal  value  problem 


I 


k kA  ♦ A*k  Q - kBR'^S’k,  k(l)  - n,  (5) 
Rewriting 

B - iBj  Bjl  (6) 

CO  confora  with  Che  partitioning  (J)  of  R, 
we  obtain  the  singularly  perturbed  Rlccatl 
equation 


c^(k  ♦ kA  A’k  + Q - kB^R"*Bjk) 

• kBjR'^Bjk.  k(l)  • n. 


(7) 


In  Boat  singular  perturbation  problesis,  the 
Halting  solution  as  the  small  parameter  t 
goes  CO  zero  Is  usually  obtained  as  the 
solution  of  the  reduced  problem  obtained 
when  c • 0 |cf.  O’Malley  (1974)  and 
(1978a)).  Here,  then,  k might  be  expected 
to  have  an  asymptotic  expansion 


K(t.t)  -v-  I K,(t)t^  (8) 

J-0  J 

for  t < 1.  Corresponding  to  (7),  we  have 
the  reduced  equation 


W'2^‘2*-0  ’ °- 

Any  solution  of  (9)  must  satisfy 


(9) 


BjKjj  - 0 (10) 

for  the  m^  > n matrix  B^.  In  the  unlikely 

situation  tliat  B^  were  square  and  nonslng* 
ular,  we'd  obtain  the  unique  solution 
Kjj  ■ 0.  Otherwise,  (9)  merely  restricts 

to  lie  In  the  null  space  of  ^ space  of 

dimension  complementary  to  the  rank  of  B^. 

We  note  Cliat  (8)  will  not  generally  be  valid 
near  t • 1 because  the  given  matrix  n 
may  not  satisfy  B^IDH  • 0,  In  contradic- 
tion to  (7)  and  (10).  Our  experience  sug- 
gests that  the  solution  k of  (7)  will  often 
be  of  Che  form 


k(t,t)  - K(t,c)  ♦ 1(0, e)  (11) 

where  the  "outer  solution"  K and  the 
"boundary  layer  correction"  1 both  have 
asymptotic  power  series  expansions  in  c 
and  the  terms  of  1 tend  Co  zero  as  the 
stretched  variable 


o • (1  - t)/c  (12) 

tends  to  Infinity.  For  t < 1,  the  asymp- 
totic solution  will  be  provided  by  the  outer 
expansion  (8).  To  obtain  k in  the  simple 
form  (11),  we'll  later  need  to  ask  Cliat  Il_, 
n when  c • 0,  Is  zero. 

Using  the  control  law  (4),  we  find  that  the 
corresponding  trajectory  must  satisfy  the 
linear  system 

X - (A  - BR*^B’k)x,  x(0)  prescribed.  (13) 


Thus,  It  also  satisfies  the  singularly  per- 
turbed initial  value  problem 


2* 
e X 


e^(A  - BjR’‘B|k)x  - B^r"'b'1ui, 
x(0)  prescribed. 


(14) 


For  0 < C < 1,  then,  we  can  expect  the 
limiting  trajectory  to  satisfy  the  reduced 
equac Ion 

B^R'^B'KjXo  - 0 (15) 

(since  (10)  implies  chat  B^k  ^ 

and  this  Implies  that  we  must  satisfy  the 
singular  arc  condition 

“2*1*0  ■ 

Here,  we'll  obtain  Che  unique  solution 

X„  ' 0 if  Che  m.  « n matrix  BlK,  hap- 

0 2 2 1 

pens  to  be  square  and  nonsingular.  Gener- 
ally, however,  X^  Is  merely  restricted  Co 

He  In  Che  null  space  of  We  find 

chat  there  Is  usually  nonunlform  convergence 
St  t • 0,  because  Che  prescribed  initial 
vector  won't  generally  satisfy 
B2(0)K^ (O)x(O)  *0.  A boundary  layer  at 

C ■ 1 Is  also  expected  since  k converges 
nonunlformly  there.  Thus,  the  trajectory 
might  be  asymptotically  of  the  form 

x(t,c)  • X(t,t)  B(T,t)  n(o,t)  (17) 

where  the  outer  solution  X is  asymptoti- 
cally valid  for  0 < t < 1 and  tlie  boundary 
layer  correction  m tends  to  zero  as  tlic 
stretched  variable 

T • t/t  (18) 

tends  to  Infinity  while  the  other  boundary 
layer  correction  n > 0 as  o 

Both  the  problems  (7)  and  (14)  for  the 
Rlccatl  gain  k and  tlie  state  x are  gen- 
erally singular  singular-perturbation  prob- 
lems. For  each  c > 0,  they  have  a unique 
solution.  The  limiting  problems  (10)  and 
(16),  however,  generally  have  an  infinity  of 
solutions  (since  the  matrices  B^  and 

have  nontrivial  null  spaces)  and  further 
less  obvious  analysis  is  required  to  obtain 
the  unique  limiting  solutions  and 

within  0 < t < I.  Such  problems  are  of  ^ 

Increasing  Importance  generally  in  singular  ; — 

perturbations  theory  and  in  control  |cf.  Whits  Section 

Q'Maltcy  (1977),  O'Malley  and  Flaherty  Bull  Section 

(1977),  Utkin  (1978),  or  Vasil'eva  (1975)).  0 
Other  approaches  toward  their  solution  mighty 
Include  more  explicit  use  of  the  matrix  ' 

pseudoinverse  [cf.,  e.g.,  C.imphell  (1976)  — - 

and  Campbell  et  al,  (1976)1  or,  fur  time- 
invariant  problems,  frequency  domain  tech- 
nlques  (cf.  Francis  (1977)  and  Francis  and  WWlUnlli  ODlS 
Clover  (1977)).  We  note  that  standard  anO/ot  SWCDIL 

numerical  metlsids  fur  stiff  Initial  ' 
problems  will  generally  be  unable  to 


□ □ 


integrate  (7)  and  (14)  |cf.  Flaherty  and 

K 

4 K A 4 

A'K  4 q < 

O'Malley  d978)J. 

0 

0 1 

10  ^l 

Ue  shall  limit  attention  here  to  the  Riccatl 
problem  (7)  under  (ht  hypothesis  that 

subject 

to  BlK,. 

• 0 where 

2 0 

Aj  • A - 

B2,(B'qB2) 

b;qb,  > 0. 


(19) 


t.e.,  this 
nits.  For 

sponds  to 
InltUl  dv 
■al  contro 
1977)  for 
As  is  usua 
sis,  wc  wl 
solut ion 
correction 


■ , • aatrlx  is  positive  def  i> 
■j  ■ 0,  this  restriction  corre- 

singular  arcs  of  order  one  and  to 
ItJ  function  InipulsieM  in  the  opt  i- 
1 |rf.  O'Malley  and  Jameson  (197S, 
some  discussion  and  motivation!. 

I in  singular  perturbations  analy- 

II  separately  examine  the  outer 
K(t,t)  and  the  boundary  layer 

t(o.c)  jcf.  equation  (11)J. 


THE  OUTER  RlCCATl  CAIN 

The  outer  solution  K(t,t)  siust  asymptoti- 
cally represent  the  solution  to  (7)  for 
t < 1,  so  we  must  have 

C^(ic  ♦ KA  ♦ A'K  > Q - KB^r'*BJK) 


• KBjR’^B'K 


(20) 


satisfied  as  a power  series  (8)  in  c.  In 
particular,  when  c • Q,  we  obtain  (10). 
Postmultiplyini;  by  B^,  we  have  an  equation 

for  (KB^)  . Premult Iplylng  it  by  B^  and 

equating  coefficienth  of  t^  then  Implies 
that 


B*KjB^r''b^KjB2.  B^QB^  > 0 


(21) 


by  (19),  and  this  allows  uh  to  solve  (20) 
for  ^ obtain 

B'K  • t^R2(B'KR2)*'|B^jK  ♦ Bjl)  (B^K)’ 


♦ B'KA  - B^KBjR"*B|Kj 


(22) 


where  B^j  • AB^  - B^.  SubstitutlnK  back 
into  (20)  finally  yields 


(23) 


ic  ♦ KA  ♦ A'K  + Q - KBjR‘*BJK 
- iKB^j  ♦ QB^  + (KB^)’  + A'KB^ 

- KBjR**B|KB2)|B'QB^  ♦ B^fKB^)’  ♦ B’KB^j 

♦ B’A’KBj  - B2KB,R’‘BjKB2j’'(KB2,  ♦ QB^ 

♦ (KBj)'  ♦ A’KB^  - KB^Rj'BjKB^r. 

Differential!  equations  for  successive  Cerms 
Kj  In  the  outer  expuiislun  (8)  lor  K now 

follow  by  equating  coefficients  termwise  in 
(22)  and  (21). 


snd 


snd 


Qj  • Q - QBj(B'QBj)'‘Bjq, 


S)  - (Bj  B2j|(dla*(Rj,  B'QBj))  ‘(Bj  B^jf . 

Standard  linear  regulator  theory  implies 
that  a unique  positive  semldeflnlte  solution 
to  (24)  exists  when  a positive  semidefinite 
terminal  value  K^^d)  ^0  is  prescribed 

since  Qj  » fjOPj  i 0 where 


1*1  - I - Bj(BJ0B2)‘'b'Q 


(25) 


(cf.  Anderson  and  Moore  (1971)].  Moreover, 
B^Kq  remains  constant  along  solut loni,  of 

(24).  Successive  terms  satisfy  llnear- 

Ixed  versions  of  (24)  with  B'K  obtained 


tcrsMlse  from  (22). 


2 J 


Ur  note  that  (25)  implies  that 


1 • Pj  ♦ Pj  for  Pj  • B2(BjqB^)''B'Q.  (26) 

Indeed  P^  and  P^  are  projections 
(Pj  ■ Pj  and  pj  ■ Pj)  such  that 

B'qPj  • 0,  PjBj  - 0,  and  PjP^  - 0. 

Thus,  Pj  BuipH  into  ^(B^q),  the  null 

space  of  Bjq,  and  P^  maps  into  RfB^), 

the  range  of  B^.  Likewise,  P|  maps  into 

M(Bp  and  P^  into  RfQB^).  [In  the 

special  case  that  Pj  is  symmetric, 

P|p2  * 0 and  (26)  provides  a direct  sum 

decomposition  of  n-space.)  Here  (10)  im- 
plies that 


••iK-  ■ 0, 

2 0 * 

so  the  symmetric  matrix  satisfies 

K • K P • P'K  • P'K  P 

•^0  0 1 1*^0  r 


(28) 


Thus  (24)  becomes  a terminal  value  problem 
for  would  seem  natural  to  solve 

it  subject  to  the  boundary  value 


Kjj(I)  - Pj(l)Kjj(l)Pj(l) 
- PjdlBjjPjd)  > 0. 


(29) 


( 

I 


When  t • 0,  then,  we  get  the  parameter  free 
Riccatl  equation 


The  Riccatl  equation  (24)  and  the  terminal 
value  (29)  are  the  additional  data  needed  to 
supplement  the  reduced  equation  (10)  in 


BESl  AiVj:/..LE  COPY 


order  to  uniquely  drteralnv  the  Halt  Ins 
outer  Rlcc.itl  K-iln  lor  t < 1.  Since 

is  singular,  we  note  that  (24)  Is  essen- 
tially s lower  order  Rlccatl  equation  for 
P|KoPj  In  the  null  space  of  |cf.  the 

analogous  discussion  fur  an  algebraic  Rlc- 
catl  equation  In  Kwatnv  (1974)  and  those  for 
the  Rlccatl  differential  equation  In  Prled- 
land  (1971)  and  Moylan  and  Hoore  (1971)]. 

For  higher  order  tenss  , (22)  laplies  an 

algebraic  equation  for  I**  order  to 

uniquely  obtain  the  outer  Rlccatl  gain 
K(t,c),  then,  we  need  only  prescribe  a ter- 
alnal  aatrlx 

P|(l)K(l,c)Pj(l).  (30) 

Splitting  such  a problea  up  Into  an  alge- 
braic equation  for  P^K  and  then  a differ- 
ential equation  for  P|K  corresponds  to  the 

auxiliary  and  bifurcation  equations  coamun 
In  bifurcation  theory  |cf.  Cesarl  (197S)|. 
This  approach  can  be  shown  to  be  store  gener- 
ally tenable  for  singular  problems  (cf. 
O'Malley  (1978b)). 


THE  BOl'NUAKY  laWEK  COKKtXTION  FOR  k 

Because  the  Rlccatl  gain  k and  its  outer 
solution  K both  satisfy  (7),  the  presumed 
representation  (11)  Implies  that  tlie  bound- 
ary layer  correction  l(a,t)  siust  satisfy 

-“o  ♦ 

- KBjR‘*Bjt  - lBjR**BjK)  (31) 

» IB^R'^B*!  ♦ tB^R^'B^K  ♦ KB2R”'B'f. 

If  we  seek  a power  series  solution 

1(0, c)  -s  I t.(o)t’  (32) 


to  (31),  the  limiting  equ.it  Ion  obtained  when 
c ■ 0 Implies  that  the  leading  coefficient 
Iq  Bust  satisfy 

Bjlo  - 0.  (33) 


Together,  (10)  and  (31)  will 

* ’ y con- 

tradict  tile  requirement  th.i 

n.  To 

avoid  that  difficulty,  we'l 

*141 1 

"o  ■ 

(34) 

Then  Kgd)  * 0 and  there  Is  no  need  for 
the  leading  tern  1^  of  the  boundary  layer 
correction.  The  case  d 0 deserves 

addition.il  study.  Ue  note  that  additional 
coaplicat Ions  occurred  in  earlier  singular 
perturbation  probleas  with  terminal  cost 
penalty  (cf.  O'Malley  and  Rung  (1973)  and 


enter  and  Oaltrlev  (|973)|.  Likewise,  we 
note  that  although  the  Rlccatl  gain  fur  the 
example  of  Uoahle  et  al.  (197h)  is  asymp- 
totically an  additive  function  of  t aid 
o,  the  approximate  boundary  layer  correc- 
tion Is  not  slaply  a power  series  in  t, 
but  a generalized  asymptotic  expansion  |cf. 
Olver  (1974)1. 

With  • 0,  we  take 

• 0.  (35) 


Then,  the  coefficient  of  i In  (31)  Im- 
plies that  1,  must  be  a decaying  solution 
of  * 

*10  ■ -*l»2*2‘*i*l  - 


Lq(0)  I R'*'^l)B'(l)l^(0) 


- -R'‘^^(1)B'(1)ICj(1) 


known  in  terns  of 

Cjj(l)  S r‘''^(1)B'(1)Kj(1)B2(1)r‘‘'^(1)  > 0 

(cf.  (21)  and  (22)).  We're  thereby  provided 
with  a unique  decaying  solution 


ZCo”’"  -1  -1 

- -2l.^(0)(l  4 e ” ) *Cj,‘(l)L^(0). 


Further  terns  follow  termwise  as  solutions 
of  linearized  equations.  The  needed  initial 
value  PjdlffO.t)  Is  obtained  termwise  by 

matching  with  the  outer  solution  K(l,c). 

We  note  that  the  positive  definiteness  of 
BjQBj  Is  critical  in  obtaining  the  stabil- 
ity needed  for  the  bound. iry  layer  correction 
((o,t).  The  bifurcation  aspect  recurs  since 
Pjd)!  Is  determined  via  differential 

equations,  while  P|(l)t  follows  from  the 

decay  of  (.  Mure  details  fur  the  n^  • 0 

problem  are  contained  In  O'Hallev  (1976).  A 
more  complicated  analysis  would  he  required 
If  BpBj  • 0 while  > 0 (cf. 

O'Malley  and  Jameson  (1977))  and  store  Impul- 
sive controls  would  result  In  "unbounded 
peaking"  of  the  initial  state  (cf.  Francis 
and  Clover  (1977)). 
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